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Abstract 

In this paper we study the problem of computing wavelet coefficients of compactly supported 
functions from their Fourier samples. For this, we use the recently introduced framework of gener- 
alized sampling. Our first result demonstrates that using generalized sampling one obtains a stable 
and accurate reconstruction, provided the number of Fourier samples grows linearly in the number 
of wavelet coefficients recovered. For the class of Daubechies wavelets we derive the exact constant 



o 

< 
On 

^vq of proportionality. 

Our second result concerns the optimality of generalized sampling for this problem. Under some 
mild assumptions we show that generalized sampling cannot be outperformed in terms of approxima- 
tion quality by more than a constant factor. Moreover, for the class of so-called perfect methods, any 
attempt to lower the sampling ratio below a certain critical threshold necessarily results in exponen- 
tial ill-conditioning. Thus generalized sampling provides a nearly-optimal solution to this problem. 
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> 1 Introduction 

0\ 

One of the most fundamental problems in sampling theory is the issue of how to recover an object - an 
image or signal, for example - from a finite, and typically fixed, collection of its measurements. This 
problem lies at the heart of countless algorithms, with applications ranging from medical imaging to 
astronomy. 

An important instance of this problem is that of Magnetic Resonance Imaging (MRI). Mathematically, 

this can be modelled as the recovery of a function (the image) from a collection of pointwise samples of 

its Fourier transform. The classical approach in MRI is to recover / by computing a discrete Fourier 

. transform (DFT) of the given data. However, this approach suffers from a number of drawbacks, including 

the sensitivity to motion and the presence of unpleasant Gibbs ringing |271 146| . Such phenomena present 

H serious problems in MRI. 

03 

1.1 Wavelets in MRI 

It is known that typical images can be much more efficiently represented using wavelets than by their 
Fourier series. Images may be sparse in wavelets, or their coefficients may have improved decay prop- 
erties. Representing an MR image in this way also has several other benefits over the classical Fourier 
representation. These include better compressibility, improved feature detection (see [421 [43J and refer- 
ences therein), and easier and more effective denoising [33, 35, 45] . For these reasons, the use of wavelets 
in biomedical imaging applications has been a significant area of research for several decades |33 |l42ll43] . 
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Seeking to exploit these beneficial properties, an approach to recover wavelet coefficients directly was 
introduced in 1992 by Weaver et al |27ll4"6"] (see also |251 1551 157] and references therein). This is known as 
wavelet- encoded MM. In this technique, the MR scanner itself is modified to sample wavelet coefficients 
along one dimension, with Fourier sampling, followed by a one-dimensional DFT, applied in the other. 
The resulting reconstructed image suffers less from Gibbs ringing, has fewer motion artefacts, and can 
in principle be acquired more rapidly [55] |37J. For a medical perspective on wavelet encoding, and a 
discussion on how it can be combined with other imaging techniques such as parallel MM, see |32| . 

Unfortunately, there are a number of disadvantages to wavelet encoding, which limit its applicability. 
These include low signal-to-noise ratio [36 46 , and the extra complications encountered in the acquisition 
process due to having to modify the MR scanner [33 . Moreover, the state-of-the-art wavelet encoding 
allows only for reconstructions of wavelet coefficients of a 2D image in one direction, and thus does not 
permit one to take full advantage of general wavelets. 

Nonetheless, the intensity of work on wavelets in MRI, and in particular on wavelet encoding tech- 
niques, indicates the importance of the problem of computing wavelet coefficients of biomedical imaging. 
It also serves to highlight the fact that this problem remains largely unsolved. 

With this in mind, the purpose of this paper is to introduce and analyse a different solution to this 
problem, known as generalized sampling. Unlike wavelet encoding, which is primarily an engineering 
exercise in which the scanner itself is modified to produce different samples, we take the mathematical 
viewpoint and consider the samples as being fixed Fourier samples, and then seek to reconstruct wavelet 
coefficients directly via a post-processing algorithm. Our main conclusion is that one can perform wavelet 
encoding in MRI with generalized sampling without altering the scanner at all. This allows for the use 
of arbitrary wavelets and removes any hardware restrictions. 

Remark 1.1. The reader may wonder at this stage why wavelet encoding is necessary. Why could one 
not simply recover wavelet coefficients from standard MRI data by applying the DFT and DWT (discrete 
wavelet transform) in turn? There are two reasons. First, the use of DFT yields a discrete (pixel-based) 
version of the truncated Fourier series. Hence, by applying the DWT one (at best) obtains the wavelet 
coefficients of the truncated Fourier series and not the actual wavelet coefficients of the image itself. 
Second, the recovery algorithm using DFT and DWT would be as follows. The "wavelet coefficients" are 
obtained by 

x = DWT • DFT -1 ?/, 

where y is a vector of the Fourier samples. However, when mapping these coefficients back to the pixel 
domain, one gets 

x = DWT^'a; = DFT -1 ?/, 

which is exactly what we would get in the first place using DFT. In particular, nothing is gained here 
in terms of the quality of the reconstructed image. By contrast, wavelet encoding techniques seek to 
reconstruct the true wavelet coefficients directly. This yields a different reconstruction with qualities 
determined by the wavelet used, and not by the original Fourier series. 

1.2 Generalized sampling 

In sampling theory, the mathematical problem of recovering the coefficients of a signal or image in a 
particular basis from samples taken with respect to another basis has been studied for several decades 
|40j . Motivating this is the fact that many images and signals can be better represented in terms of 
a different basis (e.g. splines [3S] or the aforementioned wavelets) than the basis in which they are 
sampled (e.g. the Fourier basis). Some of the earliest work on this problem in its abstract form was 
carried out by Unser & Aldroubi, who introduced a mathematical reconstruction framework known as 
consistent reconstructions for shift-invariant sampling and reconstruction spaces |41| (see also |44| ) . This 
was later considered by Eldar et al, who extended this framework to frames in arbitrary Hilbert spaces 
|15l [TBI H~71 |2"T] . Further developments to more general types of signal models were introduced in [3"1] 
(see also (7J US]). 

Whilst consistent reconstructions are quite popular in engineering applications, there are a number 
of issues. As discussed in [5] |3J [JJO US] , consistent reconstructions have the significant drawback of being, 
in general, neither numerically stable or convergent as the number of samples is increased. Hence, when 
applied to the important problem of recovering wavelet coefficients of MR images, they can result in 
severe amplification of noise and round-off error. 
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Nonetheless, it transpires that these issues can be overcome completely by using a different approach, 
known as generalized sampling. Introduced by Adcock & Hansen in [3J ^ , based on elements from |26J , 
this framework allows one to recover a signal / modelled as an element of a separable Hilbert space T~L in 
terms of any Riesz basis {ipj}°^ 1 from samples {(/, Sj)}^ 1 taken with respect to any other Riesz basis 
{ s j}JLi of H. The resulting reconstruction is both convergent and numerically stable, and therefore 
an obvious candidate for the wavelet recovery problem. The extension of this framework to frames, as 
opposed to bases, was presented in [S]- See also [5]. 

Keeping this in mind, the aim of this paper is to show that generalized sampling effectively solves 
the longstanding problem of recovering wavelet coefficients from Fourier samples. Our main results are 
explained in more detail in the next section. 

1.3 Main results 

Generalized sampling obtains a reconstruction by performing a simple least-squares procedure. The 
fundamental principle which gives this method its stability and accuracy (as opposed to a consistent 
reconstruction) is that the number of computed coefficients N in the reconstruction basis {(fj}j^i (i.e. 
the wavelet basis) should be allowed to differ from the number M of acquired samples {(/, s_ ? -)}^£ 1 
(i.e. Fourier samples). In [6], this was posed in terms of the so-called stable sampling rate Q(N;6). 
Given N coefficients to be recovered, sampling at a rate M > <d(N:9) ensures a numerically stable and 
quasi-optimal reconstruction of / (see Section [2] for definitions) , with the stability and quasi-optimality 
constants depending on the fixed parameter 9. 

Understanding the behaviour of Q(N;9) is critically important from a practical standpoint. In the 
problem we consider in this paper, for example, it allows one to determine a priori how many Fourier 
samples are required to compute N wavelet coefficients in a manner that is stable and accurate (i.e. 
the computed wavelet coefficients closely approximate the exact wavelet coefficients). Clearly, it is both 
wasteful and time-consuming to acquire more samples than necessary. Hence a good estimate of the 
stable sampling rate is vital. 

To this end, the first result we prove in this paper is that the stable sampling rate is linear for any 
compactly supported wavelet basis. Thus, if N wavelet coefficients are required, one only needs O(N) 
Fourier samples of / to apply generalized sampling. In this sense, wavelets give rise to ideal bases 
for the Fourier samples reconstruction problem: up to a constant factor, there is a one-to-one ratio 
correspondence between Fourier samples and wavelet coefficients. Hence generalized sampling not only 
solves the long-standing problem of how to recover wavelet coefficients from MR data, but it also does 
so in a way that is, up to a constant factor, optimal. 

This result suggests that little can be gained in terms of reconstruction quality by altering the MR 
scanner, as is done in wavelet encoding techniques. The problem of recovering wavelet coefficients can 
be readily solved without altering the scanner by post-processing of the standard Fourier-encoded MR 
data with generalized sampling. We remark that this conclusion is due completely to the linear scaling 
of <d(N;9). Had the scaling been more severe, as can be the case for other reconstruction bases - 
orthogonal polynomials, for example, have quadratic stable sampling rates, Q(N;6) = 0(N 2 ) (a result 
due originally to Hrycak & Grochenig |30j . see also @]) - then generalized sampling may well not be as 
good an approach to the problem as alternatives based on modifying the sampling process. 

Given that wavelets have linear stable sampling rates, it is natural to ask how large the ratio rj(9) = 
M/N, which we henceforth refer to as the stable sampling ratio, is required to be. Specifically, is it 
possible to have the optimal ratio r/(9) = 1 for some moderate value of 9, and thus get a stable, accurate 
reconstruction using an equal number of wavelets as Fourier samples? Our second result shows that in 
general this is not the case. Indeed, every pair of Fourier and wavelet bases is associated with a critical 
threshold rj* below which the reconstruction becomes exponentially unstable. On the other hand, for 
certain wavelet bases, such as Daubechies wavelets, a ratio of at least rj* will ensure complete stability. 

The third issue we address in this paper is the question of optimality of generalized sampling: that 
is, whether or not it can be outperformed by a different method. This question is equivalent to asking 
whether the stable sampling rate is a quantity intrinsic to generalized sampling, or whether it is in fact 
universal. In other words, does the stable sampling rate place a fundamental limit on the number of 
Fourier samples required to recover N wavelet coefficients in a stable, accurate manner, regardless of the 
method used? 
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Optimality of generalized sampling was first discussed in [BJ. Using a general result proved therein, 
we show that the stable sampling rate is indeed universal for all so-called perfect methods (i.e. methods 
which recover finite sums of wavelets in a reasonable way; see Section [2] for a definition). As a result 
of this, we show that for wavelet reconstructions, any perfect method with ratio less than rf must be 
exponentially unstable. Hence, there is always a limit to the amount of improvement over generalized 
sampling that any perfect method can offer. 

Unfortunately, perfect methods represent only a subclass of all possible reconstruction techniques. 
Hence it cannot be claimed that the stable sampling rate is truly universal. Indeed, perfectness of a 
method implies that it recovers all functions in a particular class rather well. This leads to the following 
question: is it possible to devise a different method which outperforms generalized sampling for a single 
function /? Using our results on the linear scaling of the stable sampling rate, we show under a mild 
assumption that such a method can at best give a reconstruction whose approximation error is a constant 
factor smaller than that of generalized sampling. Thus, although it is possible to outperform generalized 
sampling in terms of approximation error, only the constant can be improved and not the asymptotic 
rate. In this sense, generalized sampling is, up to a constant factor, an oracle for the problem. 

1.4 Outline 

The outline for the remainder of this paper is as follows. In Section [2] we recap the generalized sampling 
framework of [3J[H[B]. The main results of the paper are presented and discussed in Section [3] and proofs 
are given in Sections [4f|6] In Section [7] we provide numerical results. 

2 Generalized sampling 
2.1 Generalized sampling 

In this section, we recap the main details of generalized sampling from [3111], and in particular [BJ. Let 
H be a separable Hilbcrt space with inner product (•, •) and norm ||-||. Suppose that S and T are closed 
subspaces of % satisfying the subspace condition 

T H S 1 - = {0} and T + S 1 - is closed in H. (1) 

Let {sj}°^ 1 be an orthonormal basis for S, and for / £ H, let 

fo=(f,Sj), j£N, 

be the samples of /. The reconstruction problem is to recover / with an element f £ T from its samples 

In practice, one does not have access to the whole set {fj}J^i of samples, nor can one process infinite 
amounts of information. Hence, in computations we consider the problem of recovering / from its first 
M samples 

/l) • • • , Jm- 

Also, it is usual to assume that there exists a sequence {Tn}n=i °f finite-dimensional subspaces of T 
satisfying 

oo 

71 c r 2 c • • • c r, (J t n = t. (2) 

AT=1 

For example, if {ipj}J^i is a frame or a Riesz basis for T, then one typically has 

Tn =spa,n{ipi,...,ip N }. 

The reconstruction problem is now formulated as follows: given N £ N, compute a reconstruction 
Jn,m S Tn of / from the samples {fj}fLi- 

In order to formulate what constitutes a 'good' reconstruction, we consider the following two defini- 
tions [BJ: 
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Definition 2.1. Let Fn,m '■ H — > Tn- The quasi- optimality constant fi = /U(-Fjv,Af) is the least constant 
such that 

\\f - F NtM (f)\\ <n\\f-Q N f\\, VfeH, 
where Qn ■ W — > Tn is the orthogonal projection onto Tn- // no such constant exists, we write fi = oo. 
We say that Fn,m is quasi-optimal if (j,(Fn,m) is small. 

Note that QnJ is the best approximation in norm to / from Tn- So quasi-optimality means that 
the difference in norm between / and Fn,m{J) is at most a constant factor /x of the difference between 
/ and its best approximation in the subspace Tn- 

We also define the condition number of a reconstruction: 

Definition 2.2. Let Fn,m '■ H ~* Tn be a mapping such that, for each f G %, Fn,m{I) depends only 
on the samples samples \ fj)jLx- The condition number of k(Fn,m) is given by 

(T? s v \\Fn,mU + 9)-FnmU)\\ 

K{Fn,M) = SU P llm SU P iT^ ' 

fen^o+ ge n \\9\\i 2 

0<llsll(2<e 

where g — {g^^Li ^ < £ M ■ The mapping Fn,m is well-conditioned if k(Fn,m) is small and ill-conditioned 
otherwise. 

We say that the reconstruction Fn,m is 'good' if it is stable and quasi-optimal. In other words, if the 
reconstruction constant 

C(F n ,m) = max{K(F N>M ), h(F n ,m)}, 

is small. 

As we shall explain in a moment, the key to obtaining a good reconstruction is to allow the parameter 
M, the number of samples, to vary independently from N. To this end, suppose now we write Pm ■ 7~L 
Sm for the orthogonal projection onto the subspace Sm = spanjsi, . . . , sm}, i-e. 

M 

Pm9 = ^2 ( g ' s ^ s i> 9 e n - 

i=i 

The method of tackling the reconstruction problem proposed in [3] is to let fN.M — Fn.m(J) € Tn be 
defined by 

(PmIn,m,Vo) = (PmL <Pi) , j = !,-■-, N. (3) 

Note that solving (3 I is equivalent to finding a^ N,AI ^ — ^a^' M \ . . . ,a^' M ^ £ C N as the least-squares 
solution to the problem 

jj[N,M] a lN,M] = f[M]^ 

where = {(/, si) , . . . , (/, sm)} and U^ N ' M ^ is the M by N matrix whose (i,j) th entry is (<pj,Si). 

The reconstruction Jn,m is then given by Yl^—i (Xj^'Pj- 

In [B], it was established that the reconstruction constant C(Fn,m) of generalized sampling satisfies 

C(F n ,m) = k(F n ,m) = ^{F N: m) = 



Cn,m 
where 

Cn.m = / inf (PmP,<p), 

V 11^11=1 

is the subspace angle between Tn and Sm- Moreover, since Pm — > P strongly on T-L as M — > oo (where 
P : % — > W is the projection onto S), one has, via (|T|) and ([2|, that 

Cn,ai — > 1; M — > oo, 

for fixed N E N. Thus, one obtains a good reconstruction by allowing M to be sufficiently large in 
comparison to N. 

To quantify how large M is required to be, the concept of the stable sampling rate was introduced in 

®: 
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Definition 2.3. For N £ N and 9 € (l,oo), the stable sampling rate is given by 



0(N; 9) = min MeN: < }. 

This notion of the stable sampling rate is important as it determines the number of samples required 
for guaranteed, quasi-optimal and numerically stable reconstructions. In particular, for all M > Q(N; 9), 
we have that fNM is quasi-optimal to / from Tn with constant a most 9, and the condition number 
k (Fn,m) is at worst 9. 



2.2 Optimality of generalized sampling 

In [6 the question of optimality of generalized sampling was also discussed. We now recap the main 
results proved, since they will be of use later. We first recall the definition of a perfect method: 

Definition 2.4. Let Gn.m ■ 7~L — > Tn be a mapping such that, for each f <E H, Gjv,m(/) depends only 
on the samples {fj}fLx- If G jv,m(/) — / f or oil f G Tn, then Gn.m is said to be perfect. 

Observe that the notion of perfectness is strictly weaker than quasi-optimality. Also, we remark that 
generalized sampling is a perfect method, as can be seen from 
The first result of [B] concerns such methods: 

Theorem 2.5. For M > N let Gn m ■ H Tn be a perfect reconstruction method such that, for each 
f EH, GN.Ai(f) depends only on the samples {fj}fLi- Then the condition number 

k(G n ,m) > k(F n ,m), 
where Fn,m is the generalized sampling reconstruction. 

This result implies the following: for any perfect reconstruction method, one must sample at a 
rate higher than that of generalized sampling - namely, the stable sampling rate - to obtain a stable 
reconstruction. In other words, generalized sampling cannot be improved upon in terms of its stability 
(at least for perfect methods). 

The case of non-perfect methods was also studied in [B|. The following result was proved: 

Theorem 2.6. Suppose that the stable sampling rate Q(N;6) is linear in N for a particular sampling 
and reconstruction problem. Let f € % be fixed, and suppose that there exists a sequence of mappings 

Gm ■ {fj}jLi !-> G M {f) G Tq, f (M)> 

where f : N — > N with ^f(M) < M. Suppose also that there exist constants C\(f), 02(f), Uf > such 
that 

ci(f)N- a f <\\f-Q N f\\<c 2 (f)N- a f, VW e N. (4) 
Then, given 9 G (l,oo), there exist constants c(9) € (0, 1) and Cf{9) > such that 

\\f-F c(e)MiM (f)\\<c f (6)\\f-G M (f)l VMeN, (5) 

where Fn.m is the generalized sampling reconstruction. 

This theorem demonstrates that for problems with linear stable sampling rates, even if one is allowed 
to design a method that depends on / in a completely non-trivial way, it is still not possible to obtain 
a faster asymptotic rate of convergence than that of generalized sampling. As we explain Section [3] the 
stable sampling rate is linear for wavelets, making this theorem directly applicable. 

Observe that a consequence of this theorem is that generalized sampling is, up to a constant, an 
oracle for the wavelet coefficient reconstruction problem. Suppose there was some method that, for a 
particular / satisfying Q, could recover the first N — M wavelet coefficients of / exactly (i.e. with 
no error) from M Fourier samples. The conclusion of the above corollary is that generalized sampling 
commits an error that is at worst a constant factor larger than that of this method. 
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2.3 The wavelet reconstruction and Fourier sampling spaces 

In the remainder of this paper we focus on the problem of recovering wavelet coefficients from Fourier 
samples. To this end, we now specify the corresponding sampling space S, with its corresponding 
sampling vectors {sj}jeN) &s well as the reconstruction space T with the reconstruction vectors {<fij}jeN- 
Throughout we let H = 1? (M.) with its usual inner product and will consider the recovery of functions in 
H that are compactly supported on [0, a] for some a > 1. Moreover, given / g H, its Fourier Transform 
is defined as 

f(w) = { f(x)e~ tuJX dx, lj g K. 



2.3.1 The wavelet reconstruction space 

Suppose that the reconstruction space T is generated by a mother wavelet ip and a scaling function 
<fi such that supp(?/>) = supp(<^>) = [0, a]. Then the only wavelets of interest are those whose support 
intersects [0,a]. In particular, for 

<S> jM = v' 2 <i>(y ■ -k), j,kez, 
^, fc = ^/V(2»" • -ft), j,*6Z, 

the wavelets of interest are 

n a = {<j> ,k : |fc| = 0, 1, . . . , fa] - 1} U {yj^ k : j g Z+, fc g Z, - [a] + 1 < k < V \a] - 1} . 

So, 

T = span {<£> : ip g fi Q }, 

and for sufficiently large Ti and T2, namely, Ti > fa] — 1 and T2 > 2 fa] — 1: 

L 2 [0 ) o]cTci 2 [-Ti > T 2 ]. (6) 

Elements of il a are ordered as follows: 

{•PibeN = {0o,-ral+i7 0o -rol+2) ■ * * , <Ao,rol-i) V'o -M+i, • ■ • (^ojol-i^i-M+i! ■ • • ,^1,23701-1, • ■ •}' 

(7) 

and thus 

Tat = span {ipj : j — 1, . . . , N} . (8) 

Although one can in principle consider arbitrary values of N g N, it is natural instead to consider only 
those iV for which Tn contains all wavelets up to a certain scale. To this end, we now write 

N R = 2 R fa] + (R+ l)(fa] - 1), i?GN. (9) 



We will verify in Lemma 4.1 that the subspace Tn r consists of all wavelets ipj^k of scale < j < R — 1. 



2.3.2 The Fourier sampling space 

Given [— T-i,Tq\ (the support of T), we let e < l/(r!+T 2 ) be the sampling density (or sampling distance). 
Note that l/(Ti + I2) is the corresponding Nyquist criterion for functions supported on [— T\,T<z[. We 
now define the sampling vectors by 

4 = V / ee 27rI ' e 'X[-T 1 /(e(T 1 +T 2 )),T 2 /(c(T 1 +T 2 ))], 

the sampling space by 



S e = span{< g Z} = {/ g L 2 (R) : supp(/) C [-T 1 /{e{T 1 +T 2 )),T 2 /{e{T 1 +T 2 ))}} , 
and the space spanned by the first M sampling vectors by 

r n/r 1 } 

(10) 

Moreover, P e and P^ f will denote the orthogonal projections from H onto S e and <S|^ respectively. Where 
there is no ambiguity about the value of the sampling density, we will drop the e notation and simply 
write S, Sm, P and Pm instead. 





M 


< 1 < 


~M~ 
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Remark 2.7. Observe that for all e < l/(Ti + T 2 ), T C 5 e . So, T + (5 C )- L is a closed subspace of "H 
and Tn (S 6 )^ = {0}. Thus, the subspace condition (fil of generalized sampling is satisfied. 



3 Main results 

We now state the main results of this paper. Proofs are provided in Sections [4] and [5] 



3.1 Linearity of the stable sampling rate 



The first result of this paper is that the stable sampling rate for wavelet reconstructions from Fourier 
samples is linear for any compactly supported wavelet basis. In other words, up to a constant factor 
there is a one-to-one correspondence between Fourier samples and wavelet coefficients. In particular, all 
information about a function that can be retrieved from its wavelet coefficients can still be retrieved even 
in the situation where only Fourier samples are available (and not the wavelet coefficients themselves). 
More formally, we have the following theorem: 



Theorem 3.1. Let S and T be the sampling and reconstruction spaces defined in Section \2.3\ and recall 
Nr from Let N < Nr for JJeN. Then for all 9 G (1, oo) there exists Sg G N, independent of R, 
such that for 

'S e 2 R+1 ' 



we have 



In particular, 



M = 



> 



e(N,e) < 

Hence, G{N, 9) = 0{N) for any 9 G (1, oo). 



2S g N 



Since the stable sampling rate is linear for wavelets, it makes sense to introduce the notion of a stable 
sampling ratio. We define 

V (d) = ]immp^ l > 0€(l,oc). (11) 

Note the difference between 0(iV; 9), which determines how many samples are required for each TV, and 
r](9), which stipulates asymptotically how many are required as N —> oo. We will also discuss sampling 
ratios in the context of other methods. To this end, suppose that an arbitrary method G uses Qq(N) G N 
samples to reconstruct the first N wavelet coefficients. We define the sampling ratio for that method as 



VG 



lim sup 

AT->oo 



e(AQ 

N ' 



Since the stable sampling rate is linear, we shall only consider methods G for which r/c is defined (all 
other methods necessarily give worse reconstructions asymptotically as N — > oo). 



3.2 Universality of the stable sampling rate 

The second collection of results concerns the universality of the stable sampling rate, or equivalently, the 
optimality of generalized sampling amongst all methods which recover N wavelet coefficients from M > N 
Fourier samples. Our first result is simply a corollary of Theorem |2.5| for the wavelet reconstruction 
problem from Fourier samples: 

Corollary 3.2. For N € N, let Gn be a sequence of perfect reconstruction methods with sampling ratio 
r/Q > 1. If tjq is such that /t(Gjy) f or some 9 G (l,oo) and all sufficiently large N, then rjc > v(9)> 
where rj(6) is the stable sampling ratio for generalized sampling. 
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This corollary states that, for any perfect method, the stable sampling ratio r/(8) cannot be lowered. 
In particular, any perfect method requires at least the same number of Fourier samples to achieve as 
stable a reconstruction as that of generalized sampling. 

Despite this result, in some cases it might seemingly be acceptable to forgo complete stability to obtain 
a better reconstruction. Our next theorem, which is specific to the wavelet reconstruction problem, shows 
that this cannot be done in practice: 



Theorem 3.3. Let Gn be as in Corollary 3.2 with sampling rate t]q > 1. If rja < ifop where e is as in 
Section 2.3 then re(Gjv) is unbounded and k(Gn r ) becomes exponentially large as Nr — ¥ oo, where Nr 



is as defined in 

This theorem demonstrates that any attempt to improve upon generalized sampling by lowering the 
sampling rate will result in extremely poor stability, and consequently extreme sensitivity to noise and 
round-off error. Prior to this result, one may have hoped that sampling below the critical threshold 
r\ = might only result in mildly growing condition numbers. This theorem demonstrates that this 

is not the case: stability rapidly declines dramatically once r\ < jr^r- 

Corollary |3 . 2| and Theorem |3.3| establish the universality of the stable sampling rate, and the pitfalls 
of trying to circumvent the stability barrier n > j^a]- However, they are valid only for perfect methods. 
Recall that the question of non-perfect methods was addressed by Theorem |2.6| In terms of the sampling 
ratio, this implies that any non-perfect method which has a lower sampling ratio for a particular function 
/ satisfying Q can only outperform generalized sampling by a constant factor. Note that the problem of 
recovering wavelet coefficients from Fourier samples certainly satisfies the assumptions of Theorem |2.6| 
as we prove, the stable sampling rate is linear, and for typical functions /, it is usually the case that the 
wavelet coefficients decay algebraically (which implies Q). 



3.3 Sharp results for the Daubechies wavelets 



Although Theorem |3.1| establishes linearity of the stable sampling rate for any compactly supported 
wavelet basis, it does not provide the precise constant of proportionality. Nor is it straightforward to 
determine an upper bound, since the quantity Sg is not given explicitly. Although one can in theory 
estimate Sg by carefully following the steps of the proof, we shall not do this. Instead, in this section we 
show that for the important case of Daubechies wavelets the constant can be determined exactly. 

Remark 3.4. The fact that the constant may not be known in general does not necessary prohibit 
implementation of generalized sampling. As discussed in [5], the stable sampling rate is explicitly com- 
putable, and thus the constant can actually be determined a priori for each particular case through 
numerical means. 

Our main result is as follows: 

Theorem 3.5. Let S and T be the sampling and reconstruction spaces defined in Section \2.3\ where T 
is generated by a Daubechies wavelet, and recall Nr from Then, there exists 6 G (1, oo) and R$ € N 
such that for all R > Rq, 

e(N R ,6)=\2 R /e\. 
In particular, when 1/e € Z it suffices to let 



9 > I inf 

<ee[-7r,7r] 



Moreover, in addition to this, for Haar wavelets, where a — I, we have that @{N R ,6) < \2 R /e] for all 

Ren. 



Remark 3.6. Note also that for such values of 9 and R in Theorem 3.5 if N is such that Nr-i + 1 < 
N <N R , then 

- 2 R1 
Q(N,9)< ' 
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Therefore, we have that 

1 , , \2 R /e\ 2 

— < 77(0) < lim J ^-L = 

e\a] ~ ~ R^oo N R _x + 1 e\a] 

However, our numerical results in Section [7] suggest that the optimal ratio is (e[a]) _1 and is attained 
only when N = Nr. 



4 Proof of Theorem 3.1 



The proof of Theorem [3J] requires a series of lemmas and propositions that will be presented below. The 
actual proof can be found at the very end of this section. 



4.1 Expressing wavelets in terms of the scaling function 

It is known that any compactly supported orthonormal wavelet is a Multiresolution Analysis (MRA) 
wavelet |28| . Hence, as we will demonstrate in this section, given any N £ N, all basis elements of Tn 
may be expressed as a linear combination of finitely many basis elements of {4>u t k '■ k € Z} for some 
R e N. Let therefore, for j eZ + , 

span {<fij,k '■ k € Z}, 
span {4>j,k ■ k € Z}, 
span{</> 0i fc : k € Z, |fe| < \a] - 1} , 
span {ip j!k : k e Z, - \a] + 1 < k < 2 j \a] - l} . 



v w = 
w [a) = 

3 



The following lemma relates Tn to the two latter types of subspaces. 
Lemma 4.1. For R G N, Zei 

A fl , 1 = -(2« + i) r«i + 2^- + 1, 

A R . 2 = 2 R+1 [a] -2 R -1, (12) 
V fl , Q = span{0_ Rjfe : A^i < A: < A fl , 2 } . 

Then, the following holds: 
ft) 

y ° (Q) ® (% W jJ CVfl ' a - (13) 
fii) Le£ AT = iV^ ; as defined in Then 

T N = v Q {a) © w (a) e • • • © c 

where Tn "is defined in |?p and pp. Moreover, i/ || ^lloo an( ^ Halloo ex ^j then given any ip G T/v 
sitc/i that ||(/?|| = 1 and i? > log 2 (|a] — 1), the following holds: 

j'=Ar,i j=An,i 

and 

M ^ ' 

i=A R! 2-r«i+i 

(Hi) 

4>R,k e V (a) © W (a) © • • • © whenever < fc < (2 fl - 1) [a] (14) 
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Proof. To prove (i) we start by observing that in MRA, we have that, for R G N 

V R = V ® [ ®Wi, 



v r d r ; © © w, 

\i=0 

Thus, since {4>R.k : fc G Z} is an orthonormal basis for the closed subspace Vr, it follows that, given I G Z 
such that |Z| < \a] — 1, 



,l = y2Pk^R,k, Pk = 4>o,i(x)4>R,k(x)dx. 



90 

Note that has compact support, so finitely many ^'s are non-zero. In particular, (3^ = if k is such 
that measure (supp(^o.i) n supp(0^ ! / £ )) = 0. So, j3k ^ only if 

2 R l - \a] + 1 < k < 2 R (\a~] + 1) - 1 

and this is only if 

~{2 R + 1) \a] + 2 H + 1 < k < 2 R+1 \a] - 2 R -1. (15) 
Similarly, given j, Z € Z such that < j < R - 1 and - [a] + 1 < I < 2 3 ' \a] - 1, 

feGZ 

Note that 74, = if /c is such that measure (supp(V>j,z) (1 supp(0^.fc)) = 0. Thus, 7fc 7^ only if 

2«(^)-r«i + i<*< 2 «(^M)-i. 

Hence, 7^. 7^ only if k satisfies 

-{2 R - J + 1) la] + 2 R ~ j + l<k<{2 R + 2 R - j ) la] - 2 R - j - 1. (16) 



Since we have shown that f3k and 7^ are non-zero only if (|15j) and ( 16 1 are satisfied, we have demonstrated 



that all elements in Vq © © • • • © W^-i ma y be represented as a linear combination of elements 



in Vij Q , and we have proved (13 1 



To prove (ii), note that Wphas (2* + 1) \a\ - 1 basis elements. So, V (a) © W^ a) © • • • © W R % has 



precisely 

R-l 



2 la] 1 + ((2 J + 1) M - 1) = 2 fl M + (i? + 1)(M - 1) 



3=0 



basis elements. Thus whenever N — 2 R \a] + (R+ l)([a] — 1), it follows by the ordering in (|7|, that 



TN = V^ a) ®W^®-®W^. v 



Hence, tp G T/v and \\(p\\ = 1 implies that 



R-l 2i[a,-]-l 

ip= b '^i + X) X c ^fc 

|J|<H-i j=o r«l +1 

A H , 2 

= ^ QLk<t>R,k 
k=A R , 
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for some complex numbers {a^}, {bi} and {cjy}, where 



r-i 2 J 'r<i]-i A R , 2 

E n 2 + E E M 2 = E i«/ = i 

iii< r«i — 1 j=o;=-ivi+i 3=a«,i 

by the orthonormality of the scaling functions and wavelets. 

By a similar argument to the proof of (i), it is straightforward to verify that when 2 R > fa] — 1, 



R-l 



span {fol, Vto.J ■ I = ~ M + 1. • • • , M - 2 } © W. 



(a) 



C span {<^ fe : < k < A Ra - \a] } . 
Thus, it follow that for k = Ar^ — fa] + 1, . . • , Ar, 2 , 

Oik = b\ a -\-l (<f>Q,[a^-l,4>R,k) + C 0,ra]-1 (V'O, \a] -1 1 4>R,k) ■ 

Let B k = 6|- a ]_i (<l>o,\a}-i,<f ) R,k) and Cfe = c o,[al-i (^o,ral-i)^R,fe) and suppose that both H^f^ and 
IIV'IL exist. 

Then, for j = 0, ... , fa] - 1, 



\BA R:2 -j\ < H^As.a-jll ||0O,ral-lX/ 3 

< Ml 



3 + 1 



11 °o V 2^ 

where = supp^ fl) ^ R 2 _j n supp^o.H-i C [2 fa] - 1 - (j + l)/2 fl , 2 fa] - l] . Thus 



fal-l 



J=0 



2< ll<Ol(fal + l) 
2«+! 



(17) 



Similarly, for j = 0, . . . , fa] — 1, 



\CA K , a -j\ < HVHc 



j + 1 

2* 



and 



E 1^* 



2-J 



3=0 



2-R+i 



(18) 



Hence, if i? > log 2 (fa] — 1) and both H^H^ and Halloo exist, then by Cauchy Schwarz, and estimates 
PI, PI, 



Ar,2 

E 

k=A R , 2 -[a]+l 



Ar, 2 

E i^ + ^fci 2 

k=A R , 2 -[a]+l 
A R}2 

< E (|B,| 2 + |C fc | 2 )+2 A 

k=A R ,2-\a\+l 

2 i?.+i 



, E 

\ fe=A R , 2 -|V|- 



+1 



, E i<m s 

\ fc=A H ,2-ral+l 



and this completes the proof of (ii) . 

Finally, to prove (iii) and (14), note that 



R-\ 



^R,k = E ai< ^ - 1 + E E P3,li>3,l 
iSZ 3=0 ZeZ 
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where a/ = {4>R.k,<t>o.i) and f3jj = ((j>R,k,^j,l)- If < fc < (2 H - 1) \a], then 

supp(0i?, fe ) C [0, \a]} . 



So, if 0o.; ^ Vg°\ then measure (supp((/> .;) n [0, [a]]) = and a ; = 0. Similarly, if ipj^ £ W^ a> , then 
measure (supply ) n [0, [a]]) = and fijj = 0. Hence, 

<pR, k eV^ a) ®W^®---®W { R a l 1 , 

as required. □ 



(a) 



4.2 Useful results with trigonometric polynomials 

Our proof hinges on some precise estimates on the behaviour of trigonometric polynomials. These 
estimates are presented below. 

Lemma 4.2. Let A\,A 2 € Z be such that A\ < A 2 and consider the trigonometric polynomial $(z) = 
Ej^i OLje 2 ^ z . If L e N is such that 2L > A 2 - A x + 1, then 



2L-1 

E 

3=0 



2L 



2i y 



= II* 



3=M 



Proof. Given N G N, a; = (ieo, . . . , Zjv-i) € Zjv, the Discrete Fourier Transform of x is defined by 
x = (xq, ■ • ■ , Xn-i), where 



N-l 



X k 



1 X lixikj 

— y Xje N . 



3=0 



Recall that x >->• x is a unitary operator on 1 2 {2.m) with ||x| 



P(z„) = ll*lli2(z Ar )> where 



Flli2(z„) 



JV-l 



\ J2 \ x i 

\ 3=0 



The proof of this lemma is a direct application of the Discrete Fourier Transform, with N = 2L. 
Define x = (xq, ■ • • , ajjv-i) € 1>2L as follows: 



dj+A 1 +L -L < j < -L + A 2 - A x 
otherwise 



Then: 



So, 



2L-1 



X k 



or E Xj 



_ 27Tikj 

e 2t 



3=0 
L-l 



= —?= ^ Xj+Le 
V2L ^ T 



1h 



3 = -L 



2^ a 3 e 2L 



3=M 



TvikA 1 

e e~~ 



2L 



k_ 
2L 



2L-1 



V — 

^ 2L 



k=0 



A 

2L 



2 2L-1 2L-1 



fe=0 



□ 
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The following theorem is a reworking of a result from [23, Proposition 1]: 
Theorem 4.3. Let D G N, A G E, A < xi < . . . < x r < A + 1 and suppose that 

, 1 

6 = max ar,-+i — Xj < 
j=i,...,r J J 2D 

where x r+l =x x + l. If $(x) = Ef=D x ctje 2 ^" and D 2 - D 1 < 2D, then 



(i - 2sd) \m\ L2[AtA+1) < ( $> i $ (^)i 2 1 ^ o- + 25D ) \\®\\l*[a,a + x) 



where Vj = -(xj+i — ^j— l) a7lc ^ Xq = x r — 1. 

4.3 Bounding the stable sampling rate 

We are now ready to prove the linearity of the stable sampling rate. However, before we can present the 
final proof we need a couple of technical lemmas and propositions. The following lemma is an adaptation 
of |13| Theorem 6.3.1], the proof has simply been included for clarity: 

Lemma 4.4. Let (j) be a compactly supported scaling function of some MRA. Let I be any closed interval 
of length 2ir. Then, for each 7 G (0, 1), there exists N such that for all £ E I, 



£ 1^ + 2*0 

\1\<N 



> 



7- 



Proof. First note that the orthonormality of {</>(■ — I) : I E Z} is equivalent to 



£U(£ + 27rl) 



= 1 



for all £ € R. In particular, for all £ G I, there exists N% such that for some 7 € (7, 1), 



>7- 



Since d> is continuous, it follows that 



x i-> £ 

l'l<JV 5 



(1 + 27rZ) 



is also continuous. Hence, there exists some 5j such that 



>7, Vi)eK-^,f + i £ )=:P £ . 



Note that I C U^ 6 /(7^ and 7 is compact, hence, I — U^ e jU^ for some finite subset J C I. Let 
= ma x {N 6 :£e J}. Then for all f G I, 



£ |0K+27rf) 

|i|<JV 



>7- 



□ 
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Proposition 4.5. For R,l £Z, let the vectors 4>R t i, si and the finite rank operator Pm be defined as in 
Suppose that N±,N2 G Z and ip — J^i=iv a i ( t ) R,h with ai G C, smc/i £/ia£ ^ is compactly supported 
T\,T2\. Then, for all j G Z, 



2.3 



where 



2« \2 fl 



27rej\ 
' 2* / 



JV 2 



2ttUz 



In particular, 



E 



2« 



2* 



27rej\ 
" 2« J 



Proof. Note that e < and Sj — y/ee 2 ^ 6 ' x\ t x t 2 ] , so, by the assumption on the 

support of (p, 



r 2 



s(T , i + r 2 ) 



^(x)e 27riej:,; 



= Ve0(-2nej) 

N 2 

= E a ^R,i( _27re i) 



l=N t 



;=w 1 



2« J ( 



27rej\ 
' 2 R ) 



" -11 



2* V 2fl 



27rej\ 
' 2 R ) 



□ 



Proposition 4.6. Given 7 G (0, 1) and ei, e 2 G (0, l/(Ti + T 2 )], choose £(7) G (0, 1) and (7(7) > 1 smc/i 



/<J( 7 ) S 



7t2(C( 7 ) - 1) 



v/1 - <5( 7 ) 2 > 7 - 



(19) 



Suppose that there exists M\ such that 



Then, the following holds: 



whenever 



inf ||P^|| >%), NeN. 



inf \\Pt} ip\\ > 7, N £ 



Mo = 



C{ 1 )M 1 e l 

£2 



(20) 
(21) 
(22) 
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Proof. Without loss of generality, in this proof, Mi and Mi will be even. Also, It is easy to see that 5{j) 
and C(7) always exist. Observe now that for any Mi G N, 

inf J|^ 2 HI> i n f„ , (II^aKHI " II WSJ^II) 



> 



inf 

verjv,||vll=i 



where the last inequality follows from (20 1. Hence, to prove the proposition, it suffices to determine Mi 
such that 

tp£Txr ,\\(p\\=l 

In order to understand why M2 exists, first note that P^ 2 — ¥ P t2 strongly as n — ¥ 00 and since B = 
{{if G Tn ■ \\f\\ = 1}) is finite dimensional, P^ 2 —> P e2 uniformly on B as n —> 00. Also, 7~ C 
5 ei n 5 £2 , P t2 P ei if — ip for all ip G 7tv- So, for all £ > 0, there exists M 2 such that 

inf nmni^ii > 1 - ™ P (||ph 2 p^<^ - p (2 pdm\ + \\ pe2 P e M^- HI) 

vzTn ,\\ip\\=i <peTtt,\\<p\\=i 



> 1 - £ - >/l - *(t) 2 > 7 
Thus, by the choice of #(7), for sufficiently small £ and so sufficiently large Mi, 

inf, ||PH 2 PS^||>7. 



Having established the existence of M2 we now demonstrate that (21 1 follows when M 2 takes the 



value in (22 1. We begin by letting 



, M 2 , M 2 

G Z : I > — or Z < - 1 

- 2 2 



Then 



2 (p^m 2 K 

JGBm 2 

_ / ^ 

E ( E 

J — 2 



E 



Mo 



(23) 



< E E l^^>l 2 E \(*TA*)\ 



M 2 \j = 



< E E K*M 2 >I 

ieB« 2 J= -Hi 
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Let e + = max {£1,62}, and note that 



I <-?>-?> I 



— / + e 27rie 1 ix e -27rie 2 ix da . 



/eie 2 - 



'•7ri(eij - e 2 0"\ (-ni{exj - e 2 l) 

( xj) J I — exp ' 



7r(eij - £20 



So, by substituting ( 24 1 into ( 23 ) , we have that 



p^tp^v 2 < E E ^ 



M 2 J = 



- e 2 l) 



7r(eiJ - £20 



< 



£l£2 



E E 



ki.7 - £2?r 



Suppose that M2 = \C{^)Mie\/ ' t 2 \ where C( 7 ) stems from (19), then 



< 



£l£2 



Mi E 



;> M2 |£l— -«2i| 



< £i£^ M ! 

- 7T 2 1 £ 2 (-£ 1 M 1 +£ 2 M 2 ) 

< ^ 4 



< 



7r2(C( 7 )-l)- 



Therefore, 



whenever 



Hence, 



I^JM =11^11 " ( P X? 2 ) ^ 

"C( 7 )M iei " 



> %) 2 



7T»(C( 7 )-1)- 



M 2 = 



£2 



\/l - 5(7) 2 > 7 



by the choice of 5{^) and C(7) in (19 1 



4.4 The proof 

We are now ready to present the proof of Theorem |3.1| 
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Proof of Theorem \3.1\ Recall that the reconstruction space S is defined for sampling distances e £ 
(0, l/(Ti + T 2 )]. Fix e = l/(Ti + T 2 + [a] ) and let N < N R , with R € N. 

Suppose it is known that for all 8 e (1, oo), there exists Se € N, independent of i?, such that for 

c o-R+l 



we have that 



C T h |f I! 1 \\ P£m M\ ^ 



Then, by Proposition 4.6 given 8 e (1. oo) and any sampling distance ei € (0, l/(Ti + T2)], if C(0) and 
5(6') satisfy 



then we have that 



<p£T N , llvll = l 



whenever 



A/ 



Hence, it is sufficient to prove this theorem for e = 1/{T± + T 2 + \a\ ) 
Recall Ar.i and Ar^ from (12 1, then by the choice of N and Lemma 

Tn C span{</> fljfc : A R .i <k< A R)2 } ■ 



rC(8)eM s(e) - 




"C(0)5 4W 2 ii + 1 








■f T 2 + fal). 







4.1 



(25) 



Let y> € Tn such that = 1. Then, by (25 1, we have that 

f = E a ^R^ 



l=Ai 



and 



E N 2 = 1 - ( 26 ) 

Moreover, tp is compactly supported in [— T\, T 2 ] since it is a linear combination of elements in fl a . Thus, 
by Proposition |4.5[ 

\\Pm<p\\* = E k^m 2 
i=-L^J 



E 

*=-L*J 



2 s 



27rej 
' 2* 



where 



$( 2 )= e «' e2 " 



(27) 



Let L = 2 R /e, then L is some even integer since 1/e = 7\ + T 2 + \a] = 4 [a] — 2 e N. Furthermore, 
suppose that M/2 = SX for some 5 € N. Then: 



L-l S-l 
2 \ - \ - ' 



EE 

3 =0 k=~S 
L-l 1 



E 

J=0 



I 



2« 



4> 



2 fl 

2 5-1 

E 

k=-S 



(j + kL) 



27T6 



(j + fcL) 



27TJ 



2nk 



(28) 
(29) 
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By applying Lemma 4.4 to the interval [— 27r,0], given any 9 £ (l,oo), there exists Sg £ N such that 
for all j = 0, . . .L - 1, 



Se-l 

E 

k=-S e 



2ttI 
L 



2-nk 



> 



Since 



2 R 

L = — = 2 R (A \a] - 2) > 2 R (3 \a] - 2) + \a] - 1 = A R>2 - A RA + 1, 



Lemma 4.2 (via (26 1 and (27)) implies that 



E 

j=0 



Thus, 



4> 



1 

02' 



Hence, for AT < Nr and M = Sq2 r+1 /e, where depends only on the scaling function and 0, 



CV.m = hif II-Pm^II > 

veTjv,||vl|=i 



and the theorem is proven. 



□ 



5 Proof of Theorem 3.3 



The proof of Theorem |3.3| hinges on the following proposition. 



Proposition 5.1. Let N > Nr, and suppose M — c2 R for c < -, then Cm,m ~> exponentially as 
N — > oo. 



With this result at hand the proof of Theorem |3.3| is straightforward. 

Proof of Theorem \3.3\ Suppose that t/q < ^r^r- Then, by Corollary 3.2 and Proposition 5.1, k(Gjv) 
cannot be bounded. Moreover, from [B], for M — @g(Nr), we have that 

k(G Nr ) > k(F Nr . m ) > — ^ — . 

<^N R ,M 

Hence, by Proposition |5.1| k(Gn r ) becomes exponentially large as Nr grows. □ 



The rest of this section is devoted to the proof of Proposition |5.1[ however, before we can state the 
proof, we need the following results on trigonometric polynomials and Chebyshev polynomials from |22| . 



Proposition 5.2. Let u) £ [0, 7r] and consider the following function, defined over [— it, 7r]; 

Qn,ui(z) = Qln 



sin(z/2) 
sin(aj/2) 

where Qv n (x) = cos(2n arccos x) for x £ [—1,1] is the Chebyshev polynomial of degree 2n. Then the 
following holds: 

(i) Qn,u is a trigonometric polynomial in z of degree n, i.e. Q n , ul (z) = ^ui<n a j elzJ ■ 

fa) HQn^lliocr^^i = I- 
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(Hi) For to £ [tt/2,7t), there exists constants c\,C2 > such that 

exp(cin(7r - oj)) < WQ^ujWl^^^] = QnA^) < exp(c 2 n(7r - uj)). 

Proof of Proposition \5.1\ The goal is to use Proposition |5.2| and the first p art o f the proof is a setup for 
that. In particular, let M = c2 R for some c < 1/e and R > 1. By Lemma |4~l] if < I < {2 R - 1) |~a|, 
then 



^1- 



Hence, for N > N R and p = (2 R_1 - 1) \a\ , it follows that 

Tn D V^ a) © W^ (a) © • • • © D {<p R ,i :0<l<2p}. 

Thus, we get that 



(Cn,m) 2 



2p 



2p 



inf ||Pm<^|| 2 < inf{||P A /^|| 2 : V>| 2 = 1, = V>fo,z}. 
p =i — — 



Hence, by Proposition 4.5 and the choice of Af = 02^, it follows that 



(CV,m) 2 < inf \ 



e 
2* 



< 



2 R 



27T6j\ 



2p 2p 
1=0 1=0 



L°° f— 7rce,7rce 



-7rce.7rce 



e 

2* 



**{ E 

.i=-L*J 

rfi- 1 
H E p 



2 ii 



2p 



= 53 Ae 2 "**', ||$|| 



L 2 [0,1] 



1=0 



*f^ 

^2« 



*(*) = 53 Ae 27riz Mi*iii W] = 1 

|/|< P 



The last equality above is a consequence of the following: For *(z) = Ym=o fiic 27Tlzl , 



E 



e 

2 s 



* 



2 [fl-i 

= E 2^ 
- E 



e 

2 s 



iii< P 



D 2-Kiejl/2 R 2TTitjp/2 R 



2iriejl/2 R 



(30) 



Note that we have carried out this shift in indices in order to later show that the infimum is taken over 
a set of functions which include those of the form Q n ^ defined in Proposition 5.2 From (30 1 it follows 
easily that 



-7rce,7rce 



*(*) = 53 ^ i ,\m\ 2 L2[ _ n>n] = 1 } . 



L°° [— 7rce,7rceJ L 

where we have again used that M = c2 H . Also, by Cauchy Schwarz, for $(z) — 2m< p ftl e 

|*(z)| 2 < (2 P + 1) 5] |A| 2 = (2 P + 1) U*^^ . 
Iil<p 

So, 



/ / 



ll*H2»f-^l= 2P+ 1 11*11 



L 2 [-7T,7r] 



> 1. 
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Thus, 



(C N , M ) 2 < ce 



L°° [— 7rce,7rce] 



inf < ||$| 



L°° \—7Tce,7Tce] 



*(*)=£Ae^||*||* 3[ _^>i 



< L> fl inf < ||$ 



l/l<p 



where 



= (2p+l)ce 



L°° [— 7rce,7rce] 



(31) 



Having established (31 1 we can now make use of Proposition 5.2 Indeed, for u € [7r/2, 7r), let 



where Qp.^ is defined in Proposition 5.2 Then, by Proposition 5.2 



I l«l<P 
and there exists some constant 77 > 0, independent of p, such that 

1 



ISwIlioof-c.ujl — 



< exp(— r]p(jr — u>)). 



(32) 



(33) 



L°°[-7T,7T] 

We now split the proof into two cases, and we will show that Cn,m exponentially as R — > 00 when 



Case 1: c € 



1 1 

2? e 



Case 2: c e I 0, — 
1 2e 



Case 1: By (31), (32 1 and (33 1 (and recalling the value of p = (2 fl " 1 - 1) [a]) 



CjV,Af < D R ||g 7rce || i oor_ 



7TCe,7TC€ 



< (2* \a] -2\a]+ l)ce 



L°° f— 7rce,7rcel 



exp((-ry 7 r(l- ce )(2 i? fa] -2 [a]))) 



Thus, we have shown that Cn,m decays exponentially as N —> 00 in the first case scenario. 



Case 2: Clearly, we still have exponential decay in Cn,m, since, again by (31), (32) and (33l, 

1 2 



C NM < D R I [ 1 1 iDO [-^rce,,-,*] 
II 1 1 2 

< ^HllValL-t-ir/Wa] 

< (2 R [a] - 2 [a] + l)ce 



L°° f— 7rce,7rcel 



eM-V^- 1 \a] - [a])). 



□ 



6 Proof of Theorem 3.5 



We are now ready to present the proof of Theorem |3.5| 

Remark 6.1. In the construction of Daubechies wavelets [DJI, the scaling function <f> is defined such 
that 



m ■= n 



m 



8=1 
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where 



for some N E N and C is such that 



N-l 



iaoi 2 = E 



fe=0 



1 + e-* 



N-l + k 



N 



sm 



21: 



Note that in this case, |mo(£)| > for all £ E (—ir,ir) and since 0(0) = 1, there exists K E N such 



that 



</> (£/2 K ) > for all £ € (-2tt, 2tt). Hence 



0(0 = 



2* 



n 



m 



7^0 for all£ € (-27r,27r). 



(34) 



Proof of Theorem \3.5\ Recall that e E (0, l/(7i + 12)] and from Proposition 5.1 for all c < 1/e, Cn r ,ai 
will tend to exponentially if M < 2 fl /e. So, for each 6* s (l,oo), there exists flogN such that for all 
R > R , 

0(N R: 8)> ' 



Hence, if it is known that there exists R\ and 9 E (1, 00) such that for all R> Ri 



e{N R ,9) < 



(35) 



then for such 9 and all R > max{i?o, Ri} 



Q(N R ,9) 



2R1 
c 



So, it remains to show the existence of 9 E (l,oo) such that (35) holds. Let (p E Tn r such that \\ip\\ = 1. 
Then, by Lemma |4.1| we have that 



Ar, 2 

<p = E a ^«.i' 

l=As.i 



E i«ii a = 1 . 



(36) 



where and are as defined in Q. Now, let M = [2 fl /el. Then, by Proposition |4J5 



E 

*=-L*J 



6 

2« 



4> 



27rej\ 
2 R j 



>7r 2 E 



i=-L*J 



c 
2* 



2 R 



(37) 



where 



and 



*(*) = E 



l=A t 



71 = inf 

^e[-7r£j\/2-- R -,ireM2-«] 



0(C) 



> inf 

£e[-(l+£2-«)7r : (l+e2-R)7r] 



0(0 



> 0. 



Note that 71 > due to (34) and 71 = inf^ e [_ 7r ^ 
a positive lower bound for 

E 

*=-L*J 



0(£) whenever 2 fl /e G Z. Hence, it remains to obtain 



e 

2^ 



(38) 
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We will split the proof into several cases. The case of a = 1 is treated separately mainly for pedagogical 
reasons as the proof is simpler in this case. 
Case 1: a = 1 and 1/e G N. 

Since a = 1, we have that 2 R /e > 2 R (3\a] — 2) = A R 2 - 4r,i + 1 and for 1/e € N (in which case, 
M = 2 R /e is even), Lemma 4.2 gives that 



So, given any R € N and 



we have that 



Case 2: a = 1 and 1/e £ N. 



E 



e 

2^ 



> 



2 R 



£e[-ir,jr] 

Q(N R ,0)<2 R /e. 



In this case we must have e < 1/(3 [a] — 2), and an application of Theorem 4.3 to $ with r = [2 fl /e] , 
2D = 2 R {3 \a] - 2) > Ar 2 - A fl 1; <5 = e/2 R and 



2 i? 



gives that 



MM" 1 

E 



e 

2« 



M 

y 



j - 1 , j = i, 



> (l-e(3 H -2)f >0. 



So, given any i? G N and 



> (1 - e(3 [al - 2)) inf 

1 £e[-(l+e)7T,(l+eH 



0(0 



we have that 



e(N R ,0)<2 R /e. 



Case 3: a > 1 and 2 fl /e G N for some R 



When a > 1, Lemma 4.2 and Theorem 4.3 cannot be applied directly because 2 R /e may be less than 
Ar, 2 - A R)1 + 1 = 2 R (3\a~] - 2) + [a] - 1 and so, we will first decompose $ into two other trigonometric 
polynomials for which we can obtain bounds. 

We now let R > log 2 (|"o] — 1). Since (f> and ip are continuous and compactly supported, 
HV'lloo exist. So, by Lemma 4.1 (ii) and Proposition 



and 



4.5 



r*l-i 

E 

i="L*J 



e 

2« 



2 R 



E 

i=-L*J 



c 

2« 



2* 



1 2* 



where 



•Ar,2— M A B.,2 



and 



Ar.2 

E 

i=AR,2-fol+l 



a i\ - 2 R+1 



(39) 



23 



So, as argued in ( 37 1 , 
where 



\Pmv\\ % > ll (Cl t + Cl 2 - 2C $1 C $2 



E 



e 

2* 



s = 1,2. 



If 2 R /e e N for some R, then we may apply Lemma 4.2 to <&i since 

{Ar,2 - A RA ) - {a] + 1 = 2*(3M - 2) < 2 fl /e, 



and to $2 since 
We thus obtain, 

and 

Note that 



Ar.2 - {A Ri2 - [a] + 1) + 1 = M < 2 R /e. 



cSx= E 



c 2 



E 

j=^fl,2-H+l 



1/2 



1/2 



+ C| 2 - 2C #1 C$ 2 = |a,-| 2 -2 ^2 



E 



U=Aji,2-|"al+l 



> 1 - 2 



AIHL + Woc)(M+l) 



2(ii+l)/2 



by (36 1 and (39 1. Hence, for all \i £ (0, 1), there exists Rq such that for all R > Rq, 



\\Pmv\\ > c mf , m 



(IHIoo + IMIooHM+D 
2 (fl-l)/2 



> fi inf 

fe[-7r,7r] 



<H0 



and so given any 



> ( inf 

<ee[-7r,7r] 



there exists i?o such that for all R > Rq, 



&(N R ,0)<2 R /e. 



(40) 



Case 4: a > 1 and 2 fl /e £ N for all R G N. 

In this case, e < 1/(3 [a] — 2) and as in Case 3, obtaining appropriate estimates for C$ 1 and C$ 2 
defined in ( 40 ) will provide the required low er b ound for ( 38 1 . 

In the case of C #1 , applying Theorem |4~3| to $i with r = [2 fl /e|, 2D = 2 R (3 \a\ - 2) - 2 = 
(A R , 2 -\a\)- A RA , S = e/2 R and 



2 R 



M 
~2 



3 ~ 1 , .7 = 1, 



gives that 



A R ,2-\a\ 



A R ,2-\a\ 



(i-fc) E i«,i 2 < E^i $ i(^-)i 2 <a+ 5 i) E 
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where Si = e(3[~a] — 2 — 1/2 R x ) < e(3|~a] — 2) < 1, uj = (xj+i — Xj-i)/2 and xo = x r — 1. Note that 
e/2 R+1 < Uj < 2 R /e. Hence, by po}, 



(i-5x) 2 E l«,l 2 <ci 1 <2(i + ( 5 1 ) 2 E K| 2 . 

i=A R ,\ j=A R: i 



In the case of C$ 2 , applying Theorem 4.3 to $ 2 with r = \2 R /e], 2D = 2 \(\a\ - l)/2] > A fl . 2 
(Ar,2 - H + 1), S = e/2 R and 



2 R 



M 
~2 



i - i , i = i, 



gives that 



a, 



j=A H|2 -ral+l V=l / i=A R . 2 -ra]+l 

where <5 2 < e([a| + l)/2 fl < 1, ^ = (aij+i - Xj-i)/2 and a; = z r - 1. Again, e/2 R+1 < uj < 2 R /e. So, 

Ar.2 A r2 

(i-<5 2 ) 2 E WA 2 <c% 2 < 2(1 + s 2 f E N 2 - 



Hence, 



ee[-(l+e2-«)7i-,(l+e2-«)7r] 



«'((i-«,)'-(it«i + « aL + l " U(Hti: 



2(R-3)/2 



(l- £ (3H-2)) 2 f inf , 0(0 



> as R — > oo. 
So, for all /i € (0, 1), there exists R such that for all R > i? , 



\\PAM\ 2 >^(l-e(3\^-2)) 2 inf , 0(£) 

?6 [—' "'i"'. 



> 0. 



and for all 



> (i_ e(3H _2)) inf , <j>(0 



there exists i?o such that for all R> Rq, 



e(N R ,0)<2 R /e. 



□ 



7 Numerical Examples 

In this section we provide numerical examples to illustrate the behaviour of the stable sampling rate 
as well as demonstrating sharpness of our estimates. We also show that, because of the linearity of 
the stable sampling rate, any convergence properties of a series expansion of a function in a particular 
wavelet basis will be inherited (up to a constant) by the generalized sampling reconstruction based on 
Fourier samples. In other words, as discussed in Section [2~2] generalized sampling is, up to a constant, 
an oracle for the wavelet reconstruction problem. 
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7.1 Sharpness of the stable sampling rate estimates 

Bef ore we demonstrate the sharpness of our estimates numerically, let us recall the result from Theorem 
In particular, for N R = 2 R \a] + (R + l)([<z| — 1) and when 2 R /e € Z, then for all sufficiently large 



3.5 



R 



where 



Q(N R ,6) 



2* 
e 



> 



inf 

£e[-7r : 7r] 



and cf> is the scaling function of the wavelet. Recall also the asymptotic result 

e(N R ,6) i 



lim 

R— >oo 



N R 



e\a] 



(41) 



(42) 



(43) 



In this section we demonstrate these sharp results numerically. We consider the Haar wavelet (supported 
on [0,1]), the Daubechies-4 wavelet (supported in [0,3]), and the Daubechies-6 wavelet (supported in 
[0,5]). 

For the Haar wavelet, the Fourier sampling distance must be e < 1. Since 



inf 

fe[-7r,7r] 



TV 

2' 



in this case, from the proof of Theorem 3.5 we see that (41 1 applies whenever 9 > ?. 

Figure [l] shows the growth of 8 (N, tt/2) for sampling aistances e — 1 and e = 1/2 respectively. We 
observe from the figure that 



9 (N R , tt/2) = 2 



R 



Q(N r ,tt/2) 



_ R+1 



R e N 



respectively, exactly as suggested in (41 1. Moreover, by (43 1, we have that 

G(N R ,Tr/2)~ N R J 



e\aV 



which is verified in Figure [T] via the green line. 

In the case of the DB4 and DB6 wavelets, the Fourier sampling space must be of sampling distance 
e < 1/7 and e < 1/13 respectively . Computationally we may observe that 



= 0.684 < inf 



= 0.698 < inf 



(i>DB&{x) 
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Figure 2: The figure displays the stable sampling rate Q(N, 6{) and Q(N, 62) in blue for the Daubechies-4 
wavelet (left) and the Daubechies-6 wavelet (right) with Fourier samples at a sampling distance e — 1/7 
and e = 1/13 respectively. 

where 4>dba an d 4>DB6 are the scaling function of the DB4 and DB6 wavelets respectively. So, again, as 
displayed in Figure [2] we have 



e(N R ,di) = 7- 2 R , Q{N Ri e 2 ) = lZ-2' 



RGN, 



which confirms (41 1. Moreover, by (43), we have that 

1 



1 



e(jv fl ,0i) ~n r -, e(N R ,e 2 )~N R5i 

which is verified in Figure [2] via the green line. 

Remark 7.1. Note that 

Q(N R , 9) < G(N, 0) < Q(N R+ i,9), N R < N < N R+1 . 

The staircase effect witnessed in the figures suggests that the upper bound is in fact an equality. Hence, 
although the stable sampling rate is linear for all N, from the point of view of the stable sampling rate 
at least, there is nothing to be gained from allowing N ^ N R . 



7.2 Generalized sampling and function reconstruction 

In this section we demonstrate the power of generalized sampling in practice. Given the result on the 
stable sampling rate above we have now full control over how to balance the number of Fourier samples 
versus the number of wavelet coefficients. In these experiments with Daubechies wavelets we will, in order 



to get a stable and convergent reconstruction, use the predicted value from (43 1, namely, the number of 
samples M should asymptotically satisfy 

N 

M = -=-=-, 
e\a] 

where N is the number of coefficients to be computed, e is the sampling distance and a is the maximum 
value of the support of the mother wavelet. 

We will also demonstrate, as predicted by Theorem |3.3| that failure of satisfying the stable sampling 
rate gives a completely unstable and even non-convergent reconstruction. In this case we will chose the 
disastrous value 

1 



M = cTV, 



c < 



e\aV 



which causes the condition number of the algorithm to blow up exponentially. It also makes the constant 
in the error bound blow up at the same rate and thus one gets a non-convergent method. 
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(M,N,a) 


11/ - /m||l2 


/ — /n,m\\l 2 


log II/-/n,aj 1 

log JV 


Wavelet 


(260,100,2) 
(479,184,2) 
(905,348,2) 


7.6 x 10" 3 
3.1 x 10~ 3 
9.6 x 10~ 4 


2.4 x 10~ 4 
9.3 x 10~ 5 
9.7 x 10~ 6 


1.81 
1.78 
1.97 


DB 6 
DB 6 
DB 6 


(481,206,2.5) 
(934,400,2.5) 
(1834,786,2.5) 


7.9 x 10 -3 
3.1 x 10~ 3 
1.5 x 10~ 3 


6.1 x 10 -6 
9.1 x 10~ 7 
8.6 x 10~ 8 


2.25 
2.32 
2.44 


DB 4 
DB 4 
DB 4 


(256,256,3) 
(512,512,3) 
(1024, 1024,3) 


2.1 x 10" 2 

1.2 x 10~ 2 
9.6 x 10~ 3 


2.8 x 10" 7 
5.0 x 10~ 8 
2.6 x 10~ 9 


2.72 
2.69 
2.85 


Haar 
Haar 
Haar 



Table 1: The table shows the error of the reconstructions based on classical Fourier series, Jm, as well 
as generalized sampling /n.m with different types of wavelets. Note that both Jm and Jn,m use exactly 
the same samples. 



(M,N,a) 


II/-/m|L» 


/ — }n,m \\l 2 


Noise Level e 


Wavelet 


(481,206,2.5) 
(934,400,2.5) 
(1834, 786,2.5) 


9.5 x 10~ 2 
7.4 x 10" 2 
5.0 x 10 -3 


1.4 x 10" 1 
9.8 x 10~ 2 
7.0 x 10 -3 


1.0 x 10 _1 
7.2 x 10" 2 
5.0 x 10 -3 


DB 4 
DB 4 
DB 4 


(256,256,3) 
(512,512,3) 
(1024,1024,3) 


2.1 x 10" 2 

1.2 x 10" 2 
9.6 x 10" 3 


6.4 x 10~ 4 
4.8 x 10" 5 
3.8 x 10" 6 


4.2 x 10~ 4 
3.1 x 10" 5 
2.5 x 10" 6 


Haar 
Haar 
Haar 



Table 2: The table shows the error of the reconstructions based on classical Fourier series, Jm, as well 
as generalized sampling /jy m with different types of wavelets, where the samples are contaminated with 
noise. Note that both Jm and Jn,m use exactly the same samples. 



The test functions will be of the form 

oo 
3=1 



\Pj\ = 0(j- a ), a>l, 



(44) 



where the cpjS are different types of Daubechies wavelets. We let Jn,m denote the function that is 
constructed with generalized sampling using M Fourier coefficients as samples and then reconstructing 
by computing N approximate wavelet coefficients. In other words, /n,m is the solution to 

(45) 



Pm/n,m, <Pj ) = (Pjaf, Vj) , i = F ■ ■ • , N, 



where Pm is the projection onto the sampling space Sm, where Sm is defined in (10 1. As a comparison 
we will use the truncated Fourier series 

M 

hi = PmI = ^2{f,Sj)sj. 

3=1 

We will sometimes assume that the samples (/, Sj) are contaminated with noise and thus we observe 

Z = {(f,8i),...,(f,8 M )}+v, \\v\\=e, 

for some noise level e > 0. Note that f^j and Jn,m use exactly the same information sampled. 
The fact that 

Wf-fM\\ = \\py\\, \\f-fN,M\\<e\\Qj,f\\, 



together with (44) show that the reconstruction created by generalized sampling will asymptotically 
outperform the reconstruction based on the truncated Fourier series on the types of functions described 
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(M,a) 


11/ -fu\ 


£2 


11/ — }m/c,m\\l 2 


11/ — /m/ci,m||l2 


Noise Level e 


Wavelet 


(481,3) 


9.5 x 10 


-2 


2.3 x 10~ 7 


2.2 x 10~ 2 





DB 4 


(934, 3) 


1.6 x 10 


-3 


4.6 x 10" 8 


2.4 x 10 2 





DB 4 


(7220, 3) 


5.1 x 10 


-4 


3.0 x 10" 10 


3.5 x 10 6 





DB 4 


(481,3) 


9.5 x 10 


-2 


9.3 x 10" 6 


6.6 x 10 1 


1.0 x 10~ 5 


DB 4 


(934,3) 


1.6 x 10 


-3 


9.3 x 10~ 6 


5.3 x 10 5 


1.0 x 10" 5 


DB 4 


(7220, 3) 


5.1 x 10 


-4 


1.1 x 10" 5 


1.0 x 10 11 


1.0 x 10" 5 


DB 4 



Table 3: The table shows the error of the reconstructions based on classical Fourier series, /m, as well 
as generalized sampling /n.m with N = M/c and N = M/cx, with noiseless and noisy data. Note that 
/m and /n,m use exactly the same samples. 



in (44). In particular, since /n,m is quasi-optimal, we have that 

!og 11/ ~ In,M II _ 
logiV ~" 

for large N. This is verified in Table [T] 

Also, observe in Table [2] the predicted stability of generalized sampling. In particular, the condition 
number of generalized sampling is equal to 9 which in the case of this experiment is 7r/2 for the Haar 
case and 1.46 for the DB4. In Table|3]we demonstrate that if the number of samples M does not satisfies 
the stable sampling rate we get an unstable and non-convergent method. In particular, we compare the 
choices 

M = cN, c=—r^, M = aN, ci = 0.95c. 
e \a\ 

As verified in Table [3] the latter choice gives disastrous results. 



8 Conclusions and future work 

The aim of this paper has been to show that generalized sampling solves the problem of computing 
wavelet coefficients in a stable and accurate manner from Fourier samples. In particular, we have proved 
that the stable sampling rate is linear for all wavelets, and thus generalized sampling is, up to a constant 
factor, an optimal method for this problem. Furthermore, we have shown that, for the class of perfect 
reconstruction methods, any attempt to lower the stable sampling ratio necessarily results in exponential 
ill-conditioning . 

There arc a number of directions for future work. First, we have not considered the efficient implemen- 
tation of generalized sampling for this problem. The main issue herein is the complexity of computing the 
reconstruction. As discussed in this is 0(NM) in general (i.e. 0(N 2 ) whenever the stable sampling 
rate is linear, such as in the wavelet case), since one is required to solve a dense M x N well-conditioned 
least-squares problem. However, for wavelets at least, the corresponding matrix is extremely structured. 
It is therefore likely that this value can be reduced to 0(N (log N) 2 ) or even 0(N log N). 

Another topic we have not addressed is that of sparsity. The generalized sampling framework studied 
in this paper guarantees recovery of all signals in a wavelet basis from their Fourier samples. However, 
suppose now that the signal to be recovered is in fact sparse in the wavelet domain, or compressible (i.e. 
well approximated by a sparse signal) . Can this property be exploited to reduce the number of Fourier 
samples used in recovering the signal? 

An abstract framework for sparsity-exploiting generalized sampling was recently developed in [T]. 
Note that this is intimately related to the field of compressed sensing jB] 1201 121] ■ However, unlike the 
standard compressed sensing framework, which models signals as finite length vectors in vector spaces, 
the framework developed in [1] models signals as elements of separable, infinite-dimensional Hilbert 
spaces. As discussed in [T], the infinite-dimensional model can often be more faithful to the original 
problem, leading to significant potential benefits. For example, in the MRI problem - which is best 
modelled by the continuous, as opposed to the discrete, Fourier transform - it allows one to avoid the 
issues raised in Remark 1 1.1 1 
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The aim of future work in this direction is to combine the results of this paper with the framework of 
[T] so as to obtain a full theory for wavelet reconstructions of compressible signals from Fourier samples. 
In particular, the analogue of the stable sampling rate in [1], known as the balancing property, must 
be first analysed. Moreover, compressed sensing relies on so-called incoherence between sampling and 
reconstruction bases. This must also be estimated. 

Alongside this, there are several other extensions to be pursued. These include the generalization to 
higher dimensions, as well as the extension to more exotic objects such as contourlets |141 I38| . curvelets 
Hn] and shearlets EH] . Another open problem involves the question of Fourier samples taken 

non-uniformly. In this paper we have considered only Fourier samples taken on a regular lattice. However, 
non-uniform sampling patterns are more common in applications. The question of generalized sampling 
for non-uniform Fourier samples was considered previously in [6 within the setting of Fourier frames. 
We believe that the key results proved herein regarding the behaviour of the stable sampling rate can be 
extended to this case. 



References 

B. Adcock and A. C. Hansen. Generalized sampling and infinite-dimensional compressed sensing. 
Technical report NA2011/02, DAMTP, University of Cambridge, 2011. 

B. Adcock and A. C. Hansen. Reduced consistency sampling in Hilbert spaces. In Proceedings of 
the 9th International Conference on Sampling Theory and Applications, 2011. 

B. Adcock and A. C. Hansen. A generalized sampling theorem for stable reconstructions in arbitrary 
bases. J. Fourier Anal. Appl. (to appear), 2012. 

B. Adcock and A. C. Hansen. Stable reconstructions in Hilbert spaces and the resolution of the 
Gibbs phenomenon. Appl. Comput. Harmon. Anal., 32(3):357-388, 2012. 

B. Adcock, A. C. Hansen, E. Herrholz, and G. Teschke. Generalized sampling: extension to frames 
and ill-posed problems. Technical report NA2011/17, DAMTP, University of Cambridge, 2011. 

B. Adcock, A. C. Hansen, and C. Poon. Beyond consistent reconstructions: optimality and sharp 
bounds for generalized sampling, and application to the uniform resampling problem. Preprint, 
2012. 

T. Blumensath. Sampling theorems for signals from the union of finite-dimensional linear subspaces. 
IEEE Trans. Inform. Theory, 55(4): 1872-1882, 2009. 

E. J. Candes. An introduction to compressive sensing. IEEE Signal Process. Mag., 25(2):21-30, 
2008. 

E. J. Candes and D. L. Donoho. Recovering edges in ill-posed inverse problems: optimality of 
curvelet frames. Ann. Statist, 30(3):784-842, 2002. 

E. J. Candes and D. L. Donoho. New tight frames of curvelets and optimal representations of objects 
with piecewise C 2 singularities. Comm. Pure Appl. Math., 57(2):219-266, 2004. 

S. Dahlke, G. Kutyniok, P. Maass, C. Sagiv, H.-G. Stark, and G. Teschke. The uncertainty principle 
associated with the continuous shearlet transform. Int. J. Wavelets Multiresolut. Inf. Process., 
6(2):157-181, 2008. 

S. Dahlke, G. Kutyniok, G. Steidl, and G. Teschke. Shearlet coorbit spaces and associated banach 
frames. Applied and Computational Harmonic Analysis, 27(2): 195-214, 2009. 

I. Daubechies. Ten Lectures on Wavelets. Cbms-Nsf Regional Conference Series in Applied Mathe- 
matics. Society for Industrial and Applied Mathematics, 1992. 

M. N. Do and M. Vetterli. The Contourlet Transform: An Efficient Directional Multiresolution 
Image Representation. IEEE Transactions on Image Processing, 14(12) :2091-2106, 2005. 



30 



[15] T. Dvorkind and Y. C. Eldar. Robust and consistent sampling. IEEE Signal Process. Letters, 
16(9):739-742, 2009. 

[16] Y. C. Eldar. Sampling with arbitrary sampling and reconstruction spaces and oblique dual frame 
vectors. J. Fourier Anal. Appl., 9(l):77-96, 2003. 

[17] Y. C. Eldar. Sampling without input constraints: Consistent reconstruction in arbitrary spaces. In 
A. I. Zayed and J. J. Benedetto, editors, Sampling, Wavelets and Tomography, pages 33-60. Boston, 
MA: Birkhauser, 2004. 

[18] Y. C. Eldar. Robust recovery of signals from a structured union of subspaces. IEEE Trans. Inform. 
Theory, 55(11):5302-5316, 2009. 

[19] Y. C. Eldar and T. Dvorkind. A minimum squared-error framework for generalized sampling. IEEE 
Trans. Signal Process., 54(6):2155-2167, 2006. 

[20] Y. C. Eldar and G. Kutyniok, editors. Compressed Sensing: Theory and Applications. Cambridge 
University Press, 2012. 

[21] Y. C. Eldar and T. Werther. General framework for consistent sampling in Hilbert spaces. Int. J. 
Wavelets Multiresolut. Inf. Process., 3(3):347, 2005. 

[22] T. Erdelyi. Remez-type inequalities on the size of generalized polynomials. J. London Math. Soc, 
45:255-264, 1992. 

[23] H. G. Feichtinger, K. Grochenig, and T. Strohmer. Efficient numerical methods in non-uniform 
sampling theory. Numerische Mathematik, 69:423-440, 1995. 10.1007/s002110050101. 

[24] M. Fornasier and H. Rauhut. Compressive sensing. In Handbook of Mathematical Methods in 
Imaging, pages 187-228. Springer, 2011. 

[25] N. Gelman and M. L. Wood. Wavelet encoding for 3-d gradient echo MR-imaging. Magn. Reson. 
Med., 36:613-19, 1996. 

[26] A. C. Hansen. On the solvability complexity index, the n-pseudospectrum and approximations of 
spectra of operators. J. Amer. Math. Soc, 24(1):81-124, 2011. 

[27] D. M. Healy and J. B. Weaver. Two applications of wavelet transforms in Magnetic Resonance 
Imaging. IEEE Trans. Inform. Theory, 38(2):840-862, 1992. 

[28] E. Hernandez and G. Weiss. A First Course on Wavelets. Studies in Advanced Mathematics. CRC 
Press, 1996. 

[29] A. Hirabayashi and M. Unser. Consistent sampling and signal recovery. IEEE Trans. Signal Process., 
55(8):4104-4115, 2007. 

[30] T. Hrycak and K. Grochenig. Pseudospectral Fourier reconstruction with the modified inverse 
polynomial reconstruction method. J. Comput. Phys., 229(3) :933-946, 2010. 

[31] G. Kutyniok, J. Lemvig, and W.-Q. Lim. Compactly supported shearlets. In M. Neamtu and L. Schu- 
maker, editors, Approximation Theory XIII: San Antonio 2010, volume 13 of Springer Proceedings 
in Mathematics, pages 163-186. Springer New York, 2012. 

[32] W. E. Kyriakos, W. S. Hoge, and D. Mitsouras. Generalized encoding through the use of selective 
excitation in accelerated parallel MRI. NMR Biomed., 19:379-392, 2006. 

[33] A. F. Laine. Wavelets in temporal and spatial processing of biomedical images. Annu. Rev. Biomed. 
Eng., 02:511-550, 2000. 

[34] Y. M. Lu and M. N. Do. A theory for sampling signals from a union of subspaces. IEEE Trans. 
Signal Process., 56(6):2334-2345, 2008. 



31 



[35] R. Nowak. Wavelet-based Rician noise removal for Magnetic Resonance Imaging. IEEE Trans. 
Image Proc, 8:1408-19, 1998. 

[36] L. P. Panych. Theoretical comparison of Fourier and wavelet encoding in Magnetic Resonance 
Imaging. IEEE Trans. Med. Imaging, 15(2):141-153, 1996. 

[37] L. P. Panych, P. D. Jakab, and F. A. Jolesz. Implementation of wavelet-encoded MR imaging. J. 
Magn. Reson. Imaging, 3:649-55, 1993. 

[38] D. D.-Y. Po and M. N. Do. Directional multiscale modeling of images using the contourlet transform. 
Trans. Img. Proc., 15(6):1610-1620, June 2006. 

[39] M. Unser. Splines: A perfect fit for signal and image processing. IEEE Signal Process. Mag., 
16(6):22-38, 1999. 

[40] M. Unser. Sampling-50 years after Shannon. Proc. IEEE, 88(4):569-587, 2000. 

[41] M. Unser and A. Aldroubi. A general sampling theory for nonideal acquisition devices. IEEE Trans. 
Signal Process., 42(ll):2915-2925, 1994. 

[42] M. Unser and A. Aldroubi. A review of wavelets in biomedical applications. Proc. IEEE, 84(4) :626- 
638, 1996. 

[43] M. Unser, A. Aldroubi, and A. F. Laine. Guest editorial: wavelets in medical imaging. IEEE Trans. 
Med. Imaging, 22(3):285-288, 2003. 

[44] M. Unser and J. Zerubia. A generalized sampling theory without band-limiting constraints. IEEE 
Trans. Circuits Syst. II, 45(8):959-969, 1998. 

[45] J. B. Weaver, Y. Xu, D. M. Healy, and J. R. Driscoll. Filtering MR images in the wavelet transform 
domain. Magn. Reson. Med., 21:288-295, 1991. 

[46] J. B. Weaver, Y. Xu, D. M. Healy, and J. R. Driscoll. Wavelet-encoded MR imaging. Magn. Reson. 
Med., 24:275-287, 1992. 



32 



